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IN THE CLAIMS: 

Please cancel Claims 13, 14, 16, and 22-24 without prejudice to or disclaimer 
of the recited subject matter. 

Please amend Claims 1, 15, and 17-20 and add new Claim 25 as follows. 

1. (Currently Amended) A position and orientation determination apparatus 
which identifies a parameter indicating a position and orientation of a capture unit adapted 
to capture a picture in a real space containing a plurality of feature points whose positions 
are known in a three-dimensional array, comprising: 

a position and orientation measurement unit adapted to measure the position 
and orientation of the capture unit in a method other than using a captured picture; 

a detection unit adapted to detect the plurality of feature points and their 
positions in a two-dimensional array on an image pickup screen using the picture in the 
real space captured by the capture unit; 

a prediction unit adapted to predict the positions of the feature points in the 
two-dimensional array on the image pickup screen based on the position and orientation of 
the capture unit measured by said position and orientation measurement unit; 

a correction unit adapted to correct a parameter of the measured position and 
orientation of the capture unit based on an average va lue or an avemvr weighting value of 
th e positions of the feature points on the image pickup screen of the capture unit obtained 
by said prediction unit, and based on an average va lue or an average weighting value of the 
positions of the feature points btained by said detect! n unit; and 



an image generation unit adapted to generate an image of a virtual object based 
on the corrected parameter, and to superimpose the image of the virtual obj ect on the 
picture in the real space captured by the capture unit 

2. (Original) The position and orientation determination apparatus according 
to claim 1, wherein an artificially applied marker is used as the plurality of feature points 
whose three-dimensional positions are known. 

3. (Previously Amended) The position and orientation determination apparatus 
according to claim 1, wherein a point originally existing in the real q>ace as the plurality of 
feature points whose three-dimensional positions are known, and whose two-dimensional 
positions can be detected on the image pickup screen by said detection unit. 

4. (Cancelled) 

5. (Cancelled) 

6. (Previously Amended) The position and orientation determination apparatus 
according to claim 1 , wherein said position and orientation measurement unit is a sensor 
for measuring the position and orientation of the capture unit. 
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7. (Previously Amended) The position and orientation determination apparatus 
according to claim 6, wherein said sensor is a magnetic sensor for measuring the three- 
dimensional position and orientation of the capture unit. 



8. (Previously Amended) The position and orientation detennination apparatus 
according to claim 1, wherein said correction unit corrects the parameter such that the 
capture unit either rotates or translates. 



9. (Previously Amended) The position and orientation detennination apparatus 
according to claim 1, wherein said correction unit corrects the parameter of the capture unit 
by combining rotation transform with translation transform. 

10. (Previously Amended) The position and orientation determination 
apparatus according to claim 9, wherein said correction unit corrects the parameter of the 
capture unit by combining rotation transform with translation transform alternately and 
plural times. 

1 1 . (Previously Amended) The position and orientation determination 
apparatus according to claim 9, wherein said correction unit corrects the parameter such 
that the capture unit can rotate, and then re-predicts the two-dimensional position of the 
feature point on the image pickup screen based on die position of the feature point in the 
real space and the position and orientation of the camera after the correction, and the 
capture unit can translate. 
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12. (Previously Amended) The position and orientation determination 
apparatus according to claim 9, wherein said correction unit corrects the parameter such 
that the capture unit can translate, and then re-predicts the two-dimensional position of the 
feature point on the image pickup screen based on the position of the feature point in the 
real space and the position and orientation of the camera after the correction, and the 
capture unit can rotate. 

13. (Cancelled) 

14. (Cancelled) 

0 

15. (Currently Amended) The position and orientation determination apparatus 
according to claim -B i, wherein when the parameter of the capture unit is processed plural 
times alternately by rotation transform and translation transform, said correction unit 
repeats the process until an average value or an average weighting value of an error 
between the position of the feature point corrected by said prediction unit and the position 
of the feature point on the image pickup screen is equal to or less than a predetermined 
value or until the errorcannotbe_sm^lgr. 

16. (Cancelled) 

1 7. (Currently Amended) The position and orientation determination apparatus 
according to claim i5 i, wherein when said correction unit corrects the parameter such that 
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the capture unit can rotate, the feature point whose position predicted by said prediction 
unit is associated with the feature point detected by said detection unit, a rotation axis and a 
rotation angle with which the position of die feature point on the image pickup screen of 
the capture unit using the position of the feature point obtained by said prediction unit 
matches the position of the feature point on the image pickup screen of the capture unit 
obtained by said detection unit are obtained for each feature point, and the parameter can 
be corrected by using average values of the rotation axis and the rotation angle obtained for 
each feature point which is dealt with. 

18. (Currently Amended) The position and orientation determination apparatus 
according to claim i4 1, wherein when said correction unit corrects the parameter such that 
the capture unit can rotate, the feature point whose position predicted by said prediction 
unit is associated with the feature point detected by said detection unit, a rotation axis and a 
rotation angle with which the position of the feature point on the image pickup screen of 
the capture unit using the position of the feature point obtained by said prediction unit 
matches the position of die feature point on the image pickup screen of the capture unit 
obtained by said detection unit are obtained for each feature point which is dealt with, and 
the parameter can be corrected using average weighting values of the rotation axis and the 
rotation angle obtained for each feature point which is dealt with. 

19. (Currently Amended) The position and orientation determination apparatus 
according to claim & i, wherein when said correction unit corrects the parameter such that 
the capture unit can translate, the feature point whose position predicted by said prediction 
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unit is associated with the feature point detected by said detection unit, a difference 
between the position of the feature point obtained by said prediction unit and the position 
of the feature point obtained by said detection unit is obtained for each feature point which 
is dealt with, and the parameter can be corrected using average values of the difference 
obtained for each feature point which is dealt with. 

20. (Currently Amended) The position and orientation determination apparatus 
according to claim -H L wherein when said correction unit corrects the parameter such that 
the capture unit can translate, the feature point whose position predicted by said prediction 
unit is associated with the feature point detected by said detection unit, a difference 
between the position of the feature point obtained by said prediction unit and the position 
of the feature point obtained by said detection unit is obtained for each feature point which 
is dealt with, and the parameter can be corrected using average weighting values of the 
difference obtained for each feature point which is dealt with. 

21. (Cancelled) 

22. (Cancelled) 

23. (Cancelled) 



24. (Cancelled) 
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25. (New) A position and orientation determination method which identifies a 
parameter indicating a position and orientation of a capture unit adapted to capture a 
picture in a real space containing a plurality of feature points whose positions are known in 
a three-dimensional array, said method comprising: 

a position and orientation measurement step of measuring the position and 
orientation of the capture unit with a method other than using a captured picture; 

a detection step of detecting the plurality of feature points and their positions in 




a two-dimensional array on an image pickup screen using the picture in the real space 
captured by the capture unit; 

a prediction step of predicting the positions of the feature points in the two- 



dimensional array on the image pickup screen based on the position and orientation of the 
capture unit measured in said position and orientation measurement step; 

a correction step of correcting a parameter of the measured position and 
orientation of the capture unit based on an average value or an average weighting value of 
the positions of the feature points on the image pickup screen of the capture unit obtained 
in said prediction step, and based on an average value or an average weighting value of the 
positions of the feature points obtained in said detection step; and 

an image generation step of generating an image of a virtual object based on 
the corrected parameter, and superimposing the image of the virtual object on the picture in 
the real space captured by the capture unit 



-8- 

1 : — 



